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Abstract — Closed-loop reference models have recently been 
proposed for states accessible adaptive systems. They have been 
shown to have improved transient response over their open 
loop counter parts. The results in the states accessible case are 
extended to single input single output plants of arbitrary relative 
degree. 



I. Introduction 

Recently a class of adaptive controllers with Closed-loop 
Reference Models (CRM) for states accessible control has 
been proposed IT]-!?). The main feature of this class is the 
inclusion of a Luenberger gain which feeds back the tracking 
error into the reference model. Without the Luenberger gain 
the CRM reduces to the Open-loop Reference Model (ORM) 
which is used in classical adaptive control IS], JSJ. Reference 
|[l] introduces the concept of the CRM. In references f2\- 
||4l the stability and robustness properties of the CRM based 
adaptive system, and more importantly, an improved transient 
response were established for the case when state variables 
are accessible. The transient response was quantified through 
the use of £2 norms of the model following error as well as 
the rate of control input. In ||2l-||4l, it was shown that the 
extra design freedom in the adaptive system in the form of 
the Luenberger gain allowed this improvement. Others recent 
works on states accessible CRM adaptive control can be found 
in Q, il. 

This paper addresses the next step in the design of adaptive 
systems, which is the case when only outputs are available 
for measurement rather than the entire state. It is shown that 
even with output feedback, the resulting CRM-based adaptive 
systems are first and foremost stable, and exhibit an improved 
transient response. As in the case when states are accessible, it 
is shown that this improvement is possible due to the suitable 
choice of the Luenberger gain. Unlike the approach in ||9|, 
the classical model reference adaptive control structure is used 
here. Also, our focus here is only on single-input single-output 
systems. 

Using CRMs has two advantages over ORMs: 1) The 
reference model need not be Strictly Positive Real (SPR) for 
CRM systems, and need only have the same number of poles 
and zeros as its ORM counter part; 2) In CRM systems the 
reference model, filters and Luenberger gain can be chosen so 
that the error transfer function used in the update law is SPR 
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and has arbitrarily fast poles and zeros. While the stability and 
performance bounds are given for arbitrary reference models, 
we show in Examples 1 and 2 how one can explicitly obtain 
error transfer functions of the form 

-""-^ + bis""-"^ + ■ ■ ■ b„ 



k- 



ais" 



- = kW{s) 



(1) 



where m is the relative degree of the plant to be controlled, s is 
the differential operator, k is the high-frequency gain which 
is unknown but with known sign, and the , 5; are free to 
choose so long as yV"(s) is SPR. 

Another contribution of this work comes by way of the per- 
formance analysis technique used. When studying the stability 
of output feedback adaptive systems non-minimal state space 
representations of the model following error are constructed so 
that it can be shown that all signals in the system are bounded. 
After stability is obtained, the performance analysis comes by 
way of studying the behavior of a minimal representation of 
the adaptive system. The analysis is no longer hindered by 
the unknown eigenvalues of the non-observable states in the 
error equation. It is precisely this technique that allows us 
to extend the results of transient response analysis from the 
states accessible case to the output feedback case, where we 
will show that we have complete control over the location of 
the eigenvalues of the minimal system. 

This paper is organized as follows. Section II contains the 
notation. In Section III the control problem is defined. Section 
IV contains the analysis of the ORM (classical) relative degree 
1 case. Section V and VI contain the analysis of the CRM 
relative degree 1 and 2 cases respectively. Section VII analysis 
the arbitrary relative degree case, and Section VIII closes with 
our conclusions. 

II. Notation 

All norms unless otherwise stated are the Euclidean norm 
and enduced Euclidean norm. Let 7^C[o,oo) denote the set of 
all bounded piecewiese continuous signal. 



Definition 1: Let x,y £ VC^q , 



The 



big O- 



notation, y{t) = 0[x(t)] is equivalent to the existence 
of constants Mi,Af2>0 and to G M+ such that 
\y{t)\ < Mi\x{t)\ + 'Mi yt > to. 

Definition 2: Let x,y G 'PC[o,oo)- The small o-notaion, 
y{t) = o[x{t)] is equivalent to the existence of constants 
Pit) e ^[0,00) and to G IR+ such that \y{t)\ = I3{t)x{t) Vt > 
to and linit^oo P{t) = 0. 

Definition 3: Let x,y G "PCfo.oo)- If y{t) = 0[x(t)] and 
x{t) — 0[y{t)]. Then x and y are said to be equivalent and 
denoted as x{t) ^ y[t). 
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Definition 4: Let x,y G PCjq.oo)- ^ ™d y are said to grow 
at the same rate if supj<^|a:;(T)| ^ supj<^|j/(t)|. 

Definition 5: The prime notation is an operator that re- 
moves the high frequency gain from a transfer function 



ais 



m— 1 



SO that 



W'(s) 



W{s) 
k ' 



Just as was done in ([TJ. 

III. The Control Problem 

Consider the Single Input Single Output (SISO) system of 
equations 

y{t) = W{s)u{t) (2) 

where u G R is the input, y e M is the measurable output, and 
s the differential operator. The transfer function of the plant 
is parameterized as 



(3) 



where kp is a scalar, and Z{s) and P{s) are monic polynomials 
with deg(Z(s)) < deg(P(s)). The following assumptions will 
be made throughout. 

Assumption 1: W{s) is minimum phase. 

Assumption 2: The sign of kp is known. 

Assumption 3: The relative degree of W{s) is known. 

IV. Classical n* = 1 case (ORM n* = 1) 

The goal is to design a control input u so that the output y 
in (|2]i tracks the output ym of the reference system 

Pm(s) 

where km is a scalar and Zm{s) and Pm{s) are monic 
polynomials with Wm{s) relative degree 1. Just as before we 
use the prime notation from Definition |5] 



kraW'mis) = Wm{s). 



(5) 



Assumption 4: W^j(s) is Strictly Positive Real (SPR). 
The previous assumption can be relaxed by using pre-filters 
in the adaptive law, similar to what will be done in the relative 
degree 2 controller This increased generalization though is not 
necessary for our discussion. 

The structure of the adaptive controller is now presented: 

uji{t) = Auji + bxu{t) (6) 
uj2it)=ALU2 + bxy{t) (7) 
ioit) ^ [r{t), ul{t), y{t), u:l{t)f (8) 

e{t) ^ [k{t), ej{t), eo{t), 0^{t)f (9) 

u = 0^{t)uj (10) 



where A e m(«-i)x(«-i) is Hurwitzx, bx G 



k e 



\ and e e 



T>2n 



is adaptive gain vector with 



k{t) e R, Oiit) e R"-\ 92{t) e R"-i and Ooit) e K. The 
update law for the adaptive parameter is then defined as 



e{t) = -7sign(fcp)e.ya;, 



(11) 



where Cy = y - y^- 

Before stability is proved, a discussion on parameter match- 
ing is needed. Let 9c = [fee, Of^^ ^'oc ^ic]^ ^ constant 
vector. When d{t) = 9c the forward loop and feedback loop 
take the form 

A(g) D{ec;s) 
A(s)-C(0,;,s) A(5) ■ 

For simplicity we choose A(s) = Z„i{s), but note that this is 
not necessary and the stability of the adaptive system will still 
hold. The closed loop system is now of the form 



with 

WciiOcis)^ 



yit) = Wcii9c;s)rit) 

kckpZ[s)Zm{s) 



{Zm{s) - CiOc, s))P(s) - kpZ{s)D{ec] s) 

From the Bezout Identity, a 9*^ = [k\ Of, 9^, 9^]^ exists 
such that Wci{9*; s) = W^is). 
Therefore, 



y{t) = kpW:^{s){4>^{t)Lo(t) + k*r{t)) 



and 



ey{t) = kpW^{s)m^{t), 
where = 9{t) - 9*{t) and k* fc„/fcp. 



(12) 
(13) 



A. Stability for n* = 1 

The plant in ([3]) can be represented by the unknown quadru- 
ple, {Ap 

1 bp-t ^p-i kp) 



(14) 



where 



kpcl{sI-Ap)bp^W{s). 



In general one does not need to keep the high frequency 
gain as a separate variable when writing the transfer function 
dynamics in state space form. In the context of adaptive control 
however, the sign of kp is important in proving stability and 
is therefore always singled out from the rest of the dynamics. 
Using ( fT4b . the dynamics in ( fT2] i can be represented as 



X = 
where 



AmnX + bjnni(t)'^it)uj + k*r); y^kpC^^x 
~ bp9f 



(15) 



A — 



bp9QkpCp 
bx9^kpc^ 
bxkpCp 



A + bx9f 




bp92^ 
A 





'cp 




Xp 







and X = 











UJ2 



Up 

bx 


with the reference model having an equivalent non-minimal 
representation 

Xmn — -^mnXrnn ~^ bmnk y^, — ^p^mn"^i^^ 
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with the property that 

The non-minimal error vector is defined as emn = cc — Xmn 
and satisfies the following dynamics 



(16) 



Theorem 1: Following Assumptions [T]|4] the plant in (|2]i 
with the reference model in (HJi, controller in ( fTOl i and the 
update law in (fTTl i are globally stable with the model following 
error asymptotically converging to zero. 

Proof: See 15] §5.3]. ■ 

V. CRM n* = 1 

In the case of ORM adaptive control, the reference model 
only receives one input and is unaffected by the plant state 
trajectory. In order to facilitate the use of a Luenbereger 
feedback gain i into the reference model, the reference model 
is chosen as 

where {Am,bm,Cm) is an m dimensional system in observer 
canonical form with = [0 ... 01] and satisfying 

C^(s/ - Am)b,nkm = Wrn{s). 

ym{t) is now related to the reference command r{t) and model 
following error ey{t) as 

Vrnit) = W^{s)r{t) + Wi{s){y{t) ~ y^{t)) (18) 



where 



Zeis) 



(19) 



Pmis)' 

and kg G M. along with the m — 1 order monic polynomial 
Zi{s) are a function of £ and free to choose. Subtracting (fTsT l 
from (fT2] i results in the following differential relation 



where 



Zrnis) 



(20) 



(21) 



Pmis) - keZe{s) 

Lemma 2: An £ can be chosen such that W'^{s) is SPR for 
any n* = 1 and minimum phase transfer function W,'„(s). 

Proof: The product k£Z({s) a polynomial of order n — 1 
with 71 — 1 degrees of freedom through £. Pm (s) is a monic 
polynomial of degree n. Therefore, Pm{s) — kiZg{s) is a 
monic polynomial of order n with n — 1 degrees of freedom 
determined by £. Thus for any Zm{s) the roots of Wl,{s) can 
be placed freely in the closed left-half plane such that VFg'(s) 
is SPR. ■ 

Let 

Af, = Amn + GlkpCj^^-i^ (22) 

where G transforms Xm to the controllable subspace in x,nri, 
which always exist ifTol . The non-minimal error dynamics 
therefore take the form 



-lit) — AeCmnit) 



^Cp{t)L0{t). 



(23) 



Remark 1: It is worth noting that in the construction of the 
minimal and non-minimal systems the location of the gains kp 
and km switch from being located at the input to the output. 
The non-minimal systems is never created and thus need not 
be realized. Therefore, the influence of kp whether it be on the 
input or output matrix of the state space does not matter For 
the case of the minimal reference model in ( [TtI i it is critical 
however that km appears at the input of the system. This is 
done on purpose so that given the canonical form of Cm the 
£ in ( fTTI i completely determines the zeros and high frequency 
gain of Wi,{s) in ( fT9] l. 

Theorem 3: Following Assumptions [T]|3] and £ chosen as in 
Lemma |2] the plant in ^ with the reference model in ( fTTI ). 
controller in ( fTOl i and the update law in (fTTT i are globally stable 
with the model following error asymptotically converging to 
zero. 

Proof: Given that W^{s) is SPR, there exists a 
P, = Fj > such that 



A^ Pe + PeAe ^ -Qe and Pebmn = C„ 

where Qe ~ > 0. Thus 



V 



"mnPe^rnn 



l\kp\ 



(24) 



(25) 



is a Lyapunov function with derivative V = —e^nnQe^mn- 
Barbalat Lemma ensures the asymptotic convergence of emn 
to zero. ■ 



A. Performance 

Now that we have proved stability we can return to a 
minimal representation of the error dynamics in ( l20l i which 

is 



AlCm + brnkpip^UJ, Cy = C, 



y ^m'^mi 



(26) 



where the all the eigen-values of Ag are the roots to 
Pm{s) — kiZi{s), as can be seen from (|2TI) . Recall the An- 
derson version of KY Lemma; 



AiP + PA, 



-99 



2fiP; Ph. 



m 



where 



/i = mill |Ai(A£)| , i = 1 to m. 



The following performance function 



Vp — Cj^PCm 



l\kp\ 



has a time derivative 

Vp < ~2fxelPer, 
From ( l30l l it directly follows that 

1 fXruAP), 



(27) 
(28) 

(29) 
(30) 



2fl \X,^in{P) 



M0)\\ 



1 wmr 

"f\kp\ Xmin{P) 



(31) 



Example 1: The transfer function Wp'(s) must be SPR, 
therefore, the poles of W^e(s) are limited by the location of its 
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zeros. The order of Am however is free to choose so long as 
m > 1, thus we can choose m = 1. Therefore making 



Wm,{s) = k„ 



1 



an 



where bm = k„i and A,„ = — The closed loop reference 
model transfer function therefore is 

1 



(32) 



s + a„i + I 

where £ = —I, I > 0. From ( |32] |. it is clear that there are no 
zeros limiting the location of the closed loop pole. 

Further more, the Anderson Lemma reduces to the trivial 
solution of P = 1, g = 0, and fi = a,„ + 1. Since there are no 
zeros to worry about W^{s) is SPR for all I. Therefore, ^ can 
can be chosen arbitrarily. The bound in OTI) for this example 
simplifies to 



l|e,WII 



< 



1 



=(0)|| 



10(0)11 



(33) 



2(a„i + V 7|fcpl 
Remark 2: The use of CRMs has two advantages compared 
to the use of ORMs. The first is that the reference model need 
not be SPR a priori, but only needs to be of appropriate relative 
degree. There are several methods of dealing with non-SPR 
reference models for n* = 1, but these methods require the 
use of pre-filters lITTI . or augmented error approaches (see 
121, and Section IVnli. 

The second advantage is illustrated in Example [T] Using 
this approach, a reference model can be chosen such that it 
has no zeros. When this is done and a CRM is used, the 
location of the slowest pole of the error model dynamics 
is free to choose. When using ORMs, the location of the 
slowest eigenvalue of the closed-loop error model is not free 
to choose, as speeding up the reference model eigenvalues 
without the use of CRMs will require the use of high-gain 
feedback which is equivalent to \\0*\\ being large if the open- 
loop plant has slow eigenvalues. 

VI. CRM SISO n* = 2 

Consider the dynamics in ^ where the relative degree of 
the transfer function in (O is now 2 instead of 1 and the 
reference to be followed is the CRM in (T7\ . The control input 
in ( fTOl ) will no longer lead to stable adaptation and must be 
adjusted as 



(34) 
(35) 



where ({t) is a filtered version of the regressor vector uj and 
defined as 



C(t) = A~^{s)uj{t) where A{s) = s - 



(36) 



Using the same reference model as in ( fTTI i. the error ey{t) 
now takes the form 



ey{t) = kpW^is)Ais)<p'^{t)at). 



(37) 



With £ and A{s) chosen such that the transfer function 
Wg'(s)A(s) is SPR the CRM adaptive conti'oller for n* = 2 
is stable. 



A. Performance 

The same analysis performed in the previous section can 
be used to analyze the n* = 2 case. The minimum eigenvalue 
of W'^{s)A{s) in ( l37b along with 7 control the £2 norm of 
Cy. As in the previous example, a reference model with no 
zeros that is relative degree 2 can be chosen. Then, the zeros 
of W'^{s)A{s) are completely determined by A{s) and the 
poles are freely placed with £. Thus any SPR transfer function 
of order 2 can be created with an arbitrarily fast slowest 
eigenvalue. 

VII. CRM Arbitrary n* 

The adaptive controller for n* = 2 is special given that we 
have access to 6{t). Instead, for higher relative degrees it is 
common to use an augmented error approach, where by the 
original model following error Cy is not used to adjust the 
adaptive parameter, but an augmented error signal which does 
satisfy the SPR conditions needed for stability. The augmented 
error method used in this result is Error Model 2 as presented 
in Is] §5.4], with some changes to the notation. 

For ease of exposition and clarity in presentation we present 
the kp known and kp unknown presentation in two sections. 

A. Stability for known high frequency gain 

We begin by replacing Assumption 2 with: 

Assumption 2': kp is known. 
Without loss of generality we choose k,n = kp = 1 and the 
control input for the generic relative degree case reduces to 



u{t) = r{t) + e^ {t)(^{t) 
where (•) denotes the vectors. 



(38) 

(39) 
(40) 



A feedforward time varying adaptive gain k{t) is no longer 
needed and thus r{t) has been removed from the regressor 



vector do to the fact that k„ 



1. The model following 



error then, satisfies the following differential relation 

ey = W^{s)^'^oj 



(41) 



where the reader is reminded that the prime notation removes 
the high frequency gain from transfer functions, and since 
km = /cp = 1, W^{s) = Wei-s). Similar to the use of A{s) 
in ( |36] ) for the relative degree 2 case, a stable minimally 
realized filter F{s) with no zeros is used to generate the 
filtered regressor 

C = F{s)Iuj (42) 

where / is the 2n— 1 by 2?? — 1 identity matrix, F{s) designed 
with unity high frequency gain, and F{s) and £ chosen so that 



W'f{s)^Wi{s)F-\s) 



(43) 



is SPR. 

Lemma 4: For any stable F{s) an £ can be chosen such 
that W'j:{s) is SPR. 

Proof: The proof follows the same arguments as in 
Lemma |2l ■ 
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The tuning law for the arbitrary relative degree case uses 
an augmented error Ca, which is generated from the model 
following error Cy and an auxiliary error e^. Using the CRM 
in ( fTTb . the augmented and auxiliary error are defined as: 

ea^ey + W'f{s){e^~eaC'^C) (44) 
e^^fFC- F{s)9'^uj. (45) 

A stable tuning law for the system is then defined as 

= -JCaC (46) 

Theorem 5: Following Assumptions 1, 2' and 3, with I 
chosen such that W'As) is SPR, the plant in (|2|i with the 
reference model in ( Il7b . controller in (|38] | and update law 
in ( |46] | are globally stable with the model following error Cy 
asymptotically converging to zero. 

Proof: The proof proceeds in 4 steps. First it is shown that 
9{t) and Ca are bounded and that ea,0 e £2- Second, treating 
9{t) as a bounded time-varying signal, then all signals in the 
adaptive system can grow at most exponentially. Third, if it is 
assumed that the signals grow in an unbounded fashion, then 
it can be shown that y, wi lu2, uj, C and u grow at the same 
rate. Finally, from the fact that G £2 it is shown that LJ2 and 
uj do not grow at the same rate. This results in a contradiction 
and therefore, all signals are bounded and furthermore, ey{t) 
asymptotically converges to zero. Steps 1 and 4 are detailed 
below. Steps 1-3 follow directly from |5, §5.5] with little 
changes. Step 4 does involve a modification to the analysis 
which is addressed in detail next. 

Step 1: Expanding the error dynamics in (l44l i and canceling 
like terms of W^{s)6'^u! we have 

Adding and subtracting Wj{s)d*'^C, the equation becomes 

ea = W'fis) (0^C - e.C^C) + m (47) 

where S{t) is an exponentially decaying term do to initial 
conditions and defined as 



(48) 



Breaking apart C from its definition in ( |42] | and noting that 9* 
now commutes with F{s) we have that 



Sit) = W'jis) {9*^{Fis)~Fis))Iu) 



(49) 



Therefore, if the filter F{s) is chosen to have the same initial 
conditions when constructing C, and then, 6 = for all time. 
For this reason we ignore the affect of choosing different filter 
initial conditions. The interested reader can see how one can 
prove stability in augmented error approaches where (5(0) 7^ 
||5] pg. 213], with the addition of an extra term in the Lyapunov 
function. 

A non-minimal representation of Ca is given as 



Can = AeCan + Kn (<^^C " GaC^C) 



where 



(50) 



(51) 



Given that Wf{s) is SPR, there exists a = > such 
that 



AjPa + PaAe = -Qa and Paban = Ca 

where Q^^Q^ > 0. 

Consider the Lyapunov candidate 

V~e^ Pe + ^ 



(52) 



(53) 



Differentiating along the system dynamics in dSOb and substi- 
tution of the tuning law from ( |46] | results in 

V < -el^QaCan ^ 2el^ ( ■ (54) 

Therefore, Can, 9 £ Coo and Can, 9 £ C2 

Step 2: The plant dynamics can be expressed as 

i = A„inX + bran{(F{t)^^ + r)] y = c^j„x (55) 

where with an appropriate choice of a C can be expressed as 

X = (Ajnn + bmn(t)'^ it)C) X + bjnnr (56) 

From Step 1 it is known that is bounded, and therefore 
X grows at most exponentially. Futhermore, for r piecewise 
continuous, x and ( are both piecewise continuous as well. 

Step 3: If it is assumed that all signals grow in an un- 
bounded fashion then it can be shown that 



sup|?/(t)| sup||wi(r)|| ^ sup||w2(r)|| . . 

T<t T<t T<t 

~ sup||w|| ^ supllCII ^ sup|u(r) 



(57) 



T<t 



T<t 



B §5.5] 

Step 4: Rewinting ( |45] | in terms of tu we have that 



A oT 



F{s)Iuj - ^(.s)^' UJ 



(58) 



and given that 9 £ C2 and F{s) is stable the following holds 



sup||w(r)|| 



(59) 



The above bound follows from the Swapping Lemma ||5] 
Lemma 2.11]. From ( |46] l and the fact that 9 £ C2 we have 
that BaC G €2- Given that Wj (s) is asymptotically stable, ||5] 
Lemma 2.9] can be applied and it follows that 



sup|lC(r)|l 



(60) 



The plant output can be written in terms of the reference model 
and model following error as 

y{t) =y,n{t) + ey{t) 

=W:^{s)r{t) + {l + WKs))ey{t). 

Using (Hill, ey{t) = Ca - Wf{s) (e^ - eaC^C) and the above 
equation expands as 

y{t) =WUs)r{t) + {l + W^{s))ea 
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Using ( |59] l ( [60] l and noting that 1 + ^^'(.s) is asymptotically 
stable fSl Lemma 2.9] can be applied again and 

y{t) ^W:^{s)r{t) + {1 + W^{s))ea 



and the filter is chosen as 



sup||C(r)|| 



sup||w(t)|| 

T<t 



Given that r and are piecewise continuous and bounded we 
finally have that 



sup|1w(t)|| 



(61) 



This contradicts ( fSTl i and therefore all signals are bounded. 
Furthermore, from dSOl l it now follows that Can is bounded and 
given that Can G C2, from Step 1, it follows that ear, asymp- 
totically converges to zero and therefore \init-^oo ea{t) = 0. 
From i5% it follows that asymptotically converges to zero. 
Therefore, limt^oo Syit) = 0. The above analysis differs from 
the analysis for the ORM output feedback adaptive control do 
to the fact that one can not a priori assume that y,n{t) is 
bounded, do to the feedback of Cy into the reference model. 



B. Performance when kp known 

Just as in the n* = 1 case, with stability proved a Lyapunov 
performance function can be studied that uses a minimal 
representation of the dynamics. That being said, consider the 
minimal representation of the dynamics in (07]) 

Bam = AiCam + bam (^^C " GqC^C) , Cy = cf^Bam (62) 

in observer canonical form so that = [0 ... 01] and 

cl„,{.8l-A,r'bam^W'jis) 

Recall the Anderson version of KY Lemma; 

AjPp + PpAi = ~gg^ - 2^Pp; Ppbam = Cam (63) 
The following performance func- 



where /i is defined in 
tion 



Vp = e 
has a time derivative 



am^P^am + 
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Vp < -2tiel„,Ppeam - 2elC^C 



From {65[ it directly follows that 



1 f '^max ( Pp ) I 



and 



2/^ V'^niin(^p) 
1 



e(0)|| 



1 110(0)11 



7 Amin(^'p) 



\m\\L_ < t: {rK..iPp)Ho)r +M\m\\' 



(64) 



(65) 



(66) 



(67) 



Ultimately we would like to compute the £2 norm of 
and Cy. Given that these norms will depend explicitly on the 
specific values of the filter and reference model, we perform 
that analysis in the following example. 

Example 2: In this example we consider a relative degree 
2 plant. The reference model is chosen as 

^™(^) = 2^/ (68) 
+ biS + 62 



F(s) = 



1 



s + fi' 

The reference model gain is expanded as 

1 T 



Then 



and 



We{s) 



1 



s2 + (&i + li)s + (62 + h) 



+ (61 (62 +Z2)' 



(69) 



(70) 



(71) 



(72) 



Since, kp = km = l, then Wm{s) = We{s) = Wi{s) 

and Wf ls) = W}(s). For stabiHty to hold Wf{s) must be SPR 
and from (l72b it is clear that the SPR condition can be satisfied 
by choosing £ and /i appropriately. More importantly though, 
we see that the slowest eignvalue of Wf{s) can be arbitrarily 
placed and thus the /i in ( |28] ) can be arbitrarily increased. 



< 3 




^"(011^ 



A detailed proof of this expression is given in Appendix lAl 
Furthermore, we have the following bound for the model 
following error 



\eymh<2\\eaml^+2\\e^{t)\ 



where 



(74) 
(75) 



can be bounded as 



'e|(0) 
2fi 



wkmh 



The bound in ( f76] l is given in Appendix IB] 

Remark 3: Now we compare the norms in ( 173] ) and ( l76] l for 
an ORM and CRM system and note that increasing both /i 
and fj, decreases the two norms. For the ORM system £ = 0, 
therefore fj, is solely a function of hi and 62 in ( i72b . The 
coefficients bi and 62 can not be arbitrarily changed without 
affecting the matching parameter vector 6*. In the presence 
of persistence of excitation, d{t) 9* and large 9* will 
directly imply a large control input. Furthermore, one can not 
arbitrarily change the reference model poles, as the reference 
model is a target behavior for the plant, in which case the 
control engineer may not want to track a reference system 
with arbitrarily fast poles. Therefore, given that bi and 62 are 
not completely free to choose this also limits the value of /i 
as Wf{s) must always be SPR. In the CRM case bi and 62 can 
be held fixed and /i, I2 and /i can be adjusted so that the poles 
of Wf{s) are arbitrarily fast and W/(s) is still SPR.Therefore, 
the added degree of freedom through £ in the CRM adaptive 
systems allows more flexibility in decreasing the £2 norm of 

By. 

Remark 4: In the above, we have derived bounds on the £2 
norm of the tracking error That the same error has finite £00 
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bounds is easily shown using Lyapunov function arguments 
and the fact that projection algorithms ensure exponential 
convergence of the error to a compact set, similar to the 
analysis in ||2l-||4l. 



C. Stability in the case of unknown high frequency gain 

When kp is unknown but with known sign as in Assumption 
2, the control structure must include k{t) into the adaptive 
vector as well as including r{t) back into the regressor vector. 
Therefore, the controller take the form of (fTOl i. repeated here 
in for clarity, 

u{t) ^ e'^{t)uj{t). 

The reference model is chosen as in ( fTTI i where Wm{s) has 
the same relative degree as the plant to be controlled and thus 
the output error is the same as in (??) but repeated for clarity 

ey{t) = kpWl{s)(j,^ {t)io{t) 

where We{s) is of the same relative degree as the plant. A 
complete filtered regressor vector then is defined as 



C = F{s)Iuj 



(77) 



where / is the 2?! by 2n identity matrix, the high frequency 
gain of F{s) is unity, and F{s) and I chosen so that 



(78) 



is SPR and Wf{s) = kmWf{s). In addition to the adaptive 
parameters in the control law however another adaptive pa- 
rameter /c^ [t) is included whose parameter error is defined as 



%P ^ k^{t) - kp 



(79) 



with an update law shortly to be defined. The error equations 
for this system then are constructed as 



ea^ey + W'fis) (k^e^-eaC^C) 
^ e^C - F{s)d'^uj. 



(80) 
(81) 



The update law for the adaptive parameters is then chosen as 



^(t) = - 7sign(fcp)eaC 



(82) 
(83) 



Theorem 6: Following Assumptions 1, 2 and 3, with £ 
chosen such that W'Js) is SPR, the plant in (|2]i with the 
reference model in (fl7] i. controller in ( fTOl i and update law in 
(l82Ti-(l83]l are globally stable with the model following error 
Cy asymptotically converging to zero. 

Proof: The entire proof would come in 4 parts just as in 
the proof of Theorem 5. We however only present a detailed 
proof of step 1 and then briefly present the other 3 steps. 



Step 1: The boundedness of Ca, 4> ™d are now addressed. 
First consider the representation of (IHOl l 

+ W'f{s){kpe^ — kpC^) 

where kpC^ has been added and subtracted from. Expanding 

fcpB^, Wj{s) and cf) we have 

+ wi{s)kpF{s)-^ {e'^c - F{s)e^uj) . 

Canceling like terms in O^uj, and adding and subtracting the 
term Wj{s)9*'^ ( the expression reduces to 

ea = W'f is) [kpcf^C + ^e^ - e.C^C) + m (84) 
where 5 is an exponentially decaying term defined as 

5{t) = W'f{s)kp (r^ - F{s)) iLo) . 

Therefore, if the filter F{s) is chosen to have the same initial 
conditions when constructing C and e^, then (5 = for all time. 
For this reason we ignore the affect of choosing different filter 
initial conditions. The interested reader can see how one can 
prove stability in augmented error approaches where (5(0) 7^ 
||5] pg. 213], with the addition of an extra term in the Lyapunov 
function. Given that 9* is constant and the following holds. 
Now consider a non-minimal representation of Ca from 
as 

San = A^ean + ban {kpCjF C, + ij^e^ - e^C^C) 



where 



-'ba 



(85) 



(86) 



Given that Wj{s) is SPR, there exists a Pa = Pj > such 
that 

A'^Pa + PaAe = -Qa and Paban = Can- (87) 

where Qa = Qj, > 0. 

Consider the Lyapunov candidate 

V = el^Paean + ^ + — (88) 

Differentiating along the system dynamics in dSOb and substi- 
tution of the tuning law from ( |46l l results in 



V < 



(89) 



k^ e Coo and ea„, 9 ^ €2- 



Therefore, e 

Step 2: Given that (f> is bounded, then ( fTSl l can grow at most 
exponentially. 

Step 3: The only difference between the kp known and 
unknown case is the addition of k{t) in the feedforward loop 
and k-^{t) in the augmented error Then, if we assume that 
signals in the system grow in an unbounded fashion and using 
the results from ( fSTl i it immediately follows that 



sup 1 2/ (r) 



sup||i:ji(t)|| ^ sup||tj2(T)|| 

T<t T<t 



sup||cj|| 



SUPIICII ^ SUP||W|| . . . .QQN 
T<t T<t ^ ' 

~ supllCII sup|it(T)| 
where ( and uj are defined in ( |42] | and (|39] l respectively. 
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Step 4: Given that 6* G £2 and F{s) is stable the following 
holds 



At) 



sup||w(t)|1 



(91) 



Then, following the same steps as in Step 4 from the proof of 
Theorem 5 we can conclude that 



y{t) = o 



sup||w(r)|| 



(92) 



This contradicts ( |90] l and therefore all signals are bounded. 
Furthermore, from dSST l it now follows that Can is bounded and 
given that Can <= ^^2, from Step 1, it follows that ean asymp- 
totically converges to zero and therefore Vmvt^aoCait) ~ 0. 
From ( I9TI 1 it follows that e^^ asymptotically converges to zero. 
Therefore, limt_j.oo c-yit) =0. ■ 



VIII. Conclusion 

This work shows that with the introduction of CRMs the 
adaptive system can have improved transient performance in 
terms of reduction of the £2 norm of the model following 
error Similar to previous work in j2|, bounds on derivatives 
of key signals in the system, and trade-off between transients 
and learning remain to be addressed and is the subject of on- 
going investigation. 
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Appendix A 
Norm of e^{t) 

In this Appendix we compute the £2 norm of e.x{t). The 
expression in (ISST i is equivalent to studying the equation 

e^it) = [r{t) - F{s)lLo{t) (93) 

Given the definition of F{s) in (|69] l we have that 

F{s)¥{i)F{s)-^ = ¥{i) - -^e^{i). (94) 

s + /i 

This allows (|93T l to be rewritten as 



s + Ji s + fl 

This is analyzed in 3 parts 

K{t)\ < xiit) + X2it) + X3{t) 

where 

Xi{t) =exmf{t,0) 



(95) 



(96) 



(97) 
(98) 



X3{t)= mT)\\^fit,T) 'S>fiT,z)Mz)\\dzdT (99) 

JO Jo 

and 

$/(t,T) =exp(-/i(<-T)). (100) 
Then the £2 norm of e^it) is obtained as 



X2(t)= ||0(r)||<i>^(i,T)e^(G)$/(r,O)dT 



3 ^00 



Squaring and integrating ( |97l ) we have that 



(101) 



(102) 



Notice that 0) = <&/(i, t)$/(t, 0) is not a function of t 
and therefore can be pulled out of the integral in (|98] | resulting 
in ^ 

X2(i)<ex(0)1>/(<,0) / WmWdr. (103) 
Using Youngs inequality 

rt . /ft \ / /-t ^ \ 1/2 

T)\\dT < i I l^dr] i I \\e{T)fdT 











and therefore 

X2it) < ex{O)Vt^f{t,O)\\0{T)\\c,. (104) 
Squaring the result above and integrating we have that 



Xlir)dr < --f^imWl 
*/i 



(105) 



Integrating the inner integral in ( |99] l we have that 



Xsit) < 



11 Jo 



{T)\\<ff{t,T){l-^f{T,0))dT. (106) 
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Noting that [1 — 0)] < 1 for all t the above simplifies to Using Young's inequality the integral in ( III6I 1 can be up- 



If \ 1/2 _ 



^3{t) < r / ■^)^^'^- (107) computing the integral in the first term reduces to 

Using Young's Inequality we have that \ ''^*2?^~-^'^M ^ —) \\^it)\\c2- Using this, squaring and in- 

tegrating ( II 16b we have that 



1/2 

\\9{T)\\<^^it,T)dT<[ I <^f{t,T)dr] r.2._^._^ ^^e^(0)^ |.^-Ml2 

/ $/(i,r)||^(r)||^rfr ) Integrating the inner integral in dl 17b we have that 



Ci{r)dr< "-^)''^ \\e{r)\\l^ (120) 



and bounding the first integral term we have that (121) 

. t .1/2 Noting that [1 — 0)] < 1 for all t the above simpHfies to 

\\e{T)\\^fit,r)dr<^( '^fit,rmr)rdr) . t . 

^ ^(109) < " r)dr. (122) 



Substitution of ( 1109b into ( 1107b . squaring and integrating we Using Young's Inequality we have that 



have that 



-'J^mWl. (1.0, jjkr)m,r<[l.,it..Hr) 



1/2 



t X 1/2 



Appendix B 

NORMOFea(t) (123) 

Noting that j-^ < a for all a,b > 0, Cy in (gUi can be and bounding the first integral term we have that 

bounded as ^^ ^ / i-t \ 1/2 

(124) 

)n of ( 1124b into ( 1122b . squaring and integrati 

have that 

/•oo 2 



From (|95] l and the definition of W/ (s) in ( |72] | the filtered error 

state from ^ satisfies the following equaUty Substitution of ( 1124b into ( 1122b . squaring and integrating we 

erit) = WeisWit) ^ Iuj(t). (112) Tj?\\u(m'^ ■ 

' ^ + i C|(r)rfr< "^''^jy''- ||^>)||L. (125) 

We will also make use of the fact that there exist an to > 1 
such that 

cxp (^fi) < TO exp (— (Ut). (113) 
is analyzed in 3 parts just as we did with 

|ec(i)| <CiW + C2(t) + C3W (114) 

where 

Ci(t)=ec(0)"i$M(^:0) (115) 
C2(0=ex(0)m/ ||0>)|l$4i,T)$^-(r,O)dT (116) 



CaW-m /VV)!!*^!^,^) / ^f{T,z)\\U:{z)\\dzdT 



(117) 



and then the £2 norm of et;(^) is obtained as 

llecWllL<3E/ C'Wd^- (118) 
Squaring and integrating ( 11151 ) we have that 



C?Mrf^<^^- (119) 



■(0) 



